Mutator Analysis

./models/bert/best_final/LR0.0004_BS256_P0.05/final/

# Model Mean Model Q1 Model Q2 Model Q3 Δ Mean Δ Q1 Δ Q2 Δ Q3
mesophilics 1.694 1.555 1.672 1.812 1.085 0.365 0.711 1.291
thermophilics 1.477 1.344 1.461 1.586 0.429 0.164 0.266 0.502
ΔPerplexity distribution
Perplexity distributions

./models/bert/best_final/LR0.001_BS512_P0.15/final/

# Model Mean Model Q1 Model Q2 Model Q3 Δ Mean Δ Q1 Δ Q2 Δ Q3
mesophilics 2.236 1.906 2.156 2.504 0.542 -0.016 0.234 0.672
thermophilics 1.682 1.430 1.602 1.859 0.224 0.023 0.141 0.297
ΔPerplexity distribution
Perplexity distributions

./models/bert/best_final/LR0.001_BS256_P0.15/final/

# Model Mean Model Q1 Model Q2 Model Q3 Δ Mean Δ Q1 Δ Q2 Δ Q3
mesophilics 2.938 2.266 2.750 3.391 -0.160 -0.688 -0.281 0.141
thermophilics 1.952 1.523 1.781 2.234 -0.046 -0.242 0.000 0.133
ΔPerplexity distribution
Perplexity distributions

./models/bert/best_final/LR0.0004_BS512_P0.05/final/

# Model Mean Model Q1 Model Q2 Model Q3 Δ Mean Δ Q1 Δ Q2 Δ Q3
mesophilics 1.785 1.633 1.766 1.914 0.993 0.297 0.609 1.211
thermophilics 1.513 1.367 1.484 1.633 0.394 0.141 0.234 0.430
ΔPerplexity distribution
Perplexity distributions

./models/bert/best_final/LR0.001_BS512_P0.10/final/

# Model Mean Model Q1 Model Q2 Model Q3 Δ Mean Δ Q1 Δ Q2 Δ Q3
mesophilics 2.036 1.789 2.000 2.238 0.743 0.109 0.391 0.922
thermophilics 1.590 1.391 1.539 1.742 0.317 0.086 0.195 0.398
ΔPerplexity distribution
Perplexity distributions

./models/bert/best_final/LR0.001_BS256_P0.10/final/

# Model Mean Model Q1 Model Q2 Model Q3 Δ Mean Δ Q1 Δ Q2 Δ Q3
mesophilics 2.001 1.781 1.961 2.188 0.777 0.156 0.422 0.938
thermophilics 1.594 1.398 1.539 1.750 0.312 0.086 0.184 0.369
ΔPerplexity distribution
Perplexity distributions

./models/bert/best_validation/LR0.0004_BS128_P0.05/best/

# Model Mean Model Q1 Model Q2 Model Q3 Δ Mean Δ Q1 Δ Q2 Δ Q3
mesophilics 1.728 1.586 1.711 1.844 1.051 0.359 0.676 1.275
thermophilics 1.474 1.336 1.445 1.586 0.432 0.172 0.270 0.484
ΔPerplexity distribution
Perplexity distributions

./models/bert/best_validation/LR0.001_BS512_P0.15/best/

# Model Mean Model Q1 Model Q2 Model Q3 Δ Mean Δ Q1 Δ Q2 Δ Q3
mesophilics 2.236 1.906 2.156 2.504 0.542 -0.016 0.234 0.672
thermophilics 1.682 1.430 1.602 1.859 0.224 0.023 0.141 0.297
ΔPerplexity distribution
Perplexity distributions

./models/bert/best_validation/LR0.001_BS256_P0.05/best/

# Model Mean Model Q1 Model Q2 Model Q3 Δ Mean Δ Q1 Δ Q2 Δ Q3
mesophilics 1.884 1.711 1.867 2.031 0.894 0.225 0.527 1.094
thermophilics 1.572 1.396 1.539 1.711 0.334 0.094 0.195 0.398
ΔPerplexity distribution
Perplexity distributions

./models/bert/best_validation/LR0.001_BS256_P0.15/best/

# Model Mean Model Q1 Model Q2 Model Q3 Δ Mean Δ Q1 Δ Q2 Δ Q3
mesophilics 2.938 2.266 2.750 3.391 -0.160 -0.688 -0.281 0.141
thermophilics 1.952 1.523 1.781 2.234 -0.046 -0.242 0.000 0.133
ΔPerplexity distribution
Perplexity distributions

./models/bert/best_validation/LR0.001_BS128_P0.10/best/

# Model Mean Model Q1 Model Q2 Model Q3 Δ Mean Δ Q1 Δ Q2 Δ Q3
mesophilics 19.539 18.625 19.125 20.375 -16.760 -17.518 -16.766 -16.061
thermophilics 18.156 17.500 18.000 18.625 -16.250 -16.812 -16.172 -15.531
ΔPerplexity distribution
Perplexity distributions

./models/bert/best_validation/LR0.001_BS256_P0.10/best/

# Model Mean Model Q1 Model Q2 Model Q3 Δ Mean Δ Q1 Δ Q2 Δ Q3
mesophilics 2.001 1.781 1.961 2.188 0.777 0.156 0.422 0.938
thermophilics 1.594 1.398 1.539 1.750 0.312 0.086 0.184 0.369
ΔPerplexity distribution
Perplexity distributions

# Model selection Learning rate Batch size Mask rate N. iterations Mean ΔPerplexity Q1 ΔPerplexity Q2 ΔPerplexity Q3 ΔPerplexity PCC
0 final 0.0004 256 0.050 0 0.001 0.000 0.000 0.000 1.000
1 final 0.0004 256 0.050 3 0.039 0.008 0.008 0.008 0.979
2 final 0.0004 256 0.050 5 0.078 0.016 0.016 0.016 0.935
3 final 0.0004 256 0.050 10 0.125 0.039 0.039 0.039 0.876
4 final 0.0004 256 0.050 20 0.202 0.076 0.076 0.076 0.504
5 final 0.0004 256 0.050 40 0.067 0.125 0.125 0.125 0.228
6 final 0.0004 256 0.050 80 0.384 0.246 0.246 0.246 0.265
7 final 0.0004 512 0.050 0 0.000 0.000 0.000 0.000 1.000
8 final 0.0004 512 0.050 3 0.030 0.006 0.006 0.006 0.916
9 final 0.0004 512 0.050 5 0.066 0.008 0.008 0.008 0.934
10 final 0.0004 512 0.050 10 0.123 0.039 0.039 0.039 0.873
11 final 0.0004 512 0.050 20 0.200 0.078 0.078 0.078 0.666
12 final 0.0004 512 0.050 40 0.305 0.133 0.133 0.133 0.305
13 final 0.0004 512 0.050 80 0.386 0.230 0.230 0.230 0.452
14 validation 0.0004 128 0.050 0 0.003 0.000 0.000 0.000 0.996
15 validation 0.0004 128 0.050 3 0.039 0.008 0.008 0.008 0.955
16 validation 0.0004 128 0.050 5 0.064 0.016 0.016 0.016 0.895
17 validation 0.0004 128 0.050 10 0.132 0.037 0.037 0.037 0.755
18 validation 0.0004 128 0.050 20 0.180 0.068 0.068 0.068 0.763
19 validation 0.0004 128 0.050 40 0.277 0.146 0.146 0.146 0.525
20 validation 0.0004 128 0.050 80 0.284 0.193 0.193 0.193 0.187
21 validation 0.0010 256 0.050 0 0.001 0.000 0.000 0.000 0.999
22 validation 0.0010 256 0.050 3 0.057 0.008 0.008 0.008 0.938
23 validation 0.0010 256 0.050 5 0.076 0.008 0.008 0.008 0.943
24 validation 0.0010 256 0.050 10 0.140 0.053 0.053 0.053 0.897
25 validation 0.0010 256 0.050 20 0.231 0.092 0.092 0.092 0.572
26 validation 0.0010 256 0.050 40 0.352 0.186 0.186 0.186 0.495
27 validation 0.0010 256 0.050 80 0.325 0.238 0.238 0.238 0.198
28 final 0.0010 256 0.100 0 0.001 0.000 0.000 0.000 1.000
29 final 0.0010 256 0.100 3 0.066 0.008 0.008 0.008 0.971
30 final 0.0010 256 0.100 5 0.092 0.016 0.016 0.016 0.937
31 final 0.0010 256 0.100 10 0.185 0.062 0.062 0.062 0.798
32 final 0.0010 256 0.100 20 0.267 0.109 0.109 0.109 0.795
33 final 0.0010 256 0.100 40 0.392 0.186 0.186 0.186 0.610
34 final 0.0010 256 0.100 80 0.486 0.270 0.270 0.270 0.502
35 final 0.0010 512 0.100 0 0.001 0.000 0.000 0.000 0.985
36 final 0.0010 512 0.100 3 0.066 0.016 0.016 0.016 0.971
37 final 0.0010 512 0.100 5 0.106 0.023 0.023 0.023 0.926
38 final 0.0010 512 0.100 10 0.176 0.045 0.045 0.045 0.843
39 final 0.0010 512 0.100 20 0.291 0.102 0.102 0.102 0.671
40 final 0.0010 512 0.100 40 0.456 0.225 0.225 0.225 0.276
41 final 0.0010 512 0.100 80 0.565 0.328 0.328 0.328 0.220
42 validation 0.0010 128 0.100 0 0.414 0.000 0.000 0.000 0.937
43 validation 0.0010 128 0.100 3 1.084 0.625 0.625 0.625 0.788
44 validation 0.0010 128 0.100 5 1.673 0.875 0.875 0.875 0.598
45 validation 0.0010 128 0.100 10 2.949 1.719 1.719 1.719 0.229
46 validation 0.0010 128 0.100 20 4.881 3.000 3.000 3.000 -0.141
47 validation 0.0010 128 0.100 40 6.746 5.016 5.016 5.016 -0.254
48 validation 0.0010 128 0.100 80 8.606 7.047 7.047 7.047 -0.270
49 validation 0.0010 256 0.100 0 0.001 0.000 0.000 0.000 1.000
50 validation 0.0010 256 0.100 3 0.060 0.016 0.016 0.016 0.954
51 validation 0.0010 256 0.100 5 0.097 0.023 0.023 0.023 0.890
52 validation 0.0010 256 0.100 10 0.161 0.055 0.055 0.055 0.927
53 validation 0.0010 256 0.100 20 0.273 0.086 0.086 0.086 0.691
54 validation 0.0010 256 0.100 40 0.383 0.195 0.195 0.195 0.584
55 validation 0.0010 256 0.100 80 0.196 0.258 0.258 0.258 0.432
56 final 0.0010 256 0.150 0 0.033 0.000 0.000 0.000 0.996
57 final 0.0010 256 0.150 3 0.120 0.000 0.000 0.000 0.934
58 final 0.0010 256 0.150 5 0.207 0.047 0.047 0.047 0.958
59 final 0.0010 256 0.150 10 0.398 0.115 0.115 0.115 0.894
60 final 0.0010 256 0.150 20 0.627 0.209 0.209 0.209 0.746
61 final 0.0010 256 0.150 40 0.852 0.326 0.326 0.326 0.599
62 final 0.0010 256 0.150 80 1.038 0.520 0.520 0.520 0.421
63 final 0.0010 512 0.150 0 0.001 0.000 0.000 0.000 0.999
64 final 0.0010 512 0.150 3 0.091 0.016 0.016 0.016 0.981
65 final 0.0010 512 0.150 5 0.150 0.031 0.031 0.031 0.945
66 final 0.0010 512 0.150 10 0.227 0.068 0.068 0.068 0.889
67 final 0.0010 512 0.150 20 0.380 0.156 0.156 0.156 0.833
68 final 0.0010 512 0.150 40 0.538 0.234 0.234 0.234 0.523
69 final 0.0010 512 0.150 80 -1.245 0.305 0.305 0.305 0.283
70 validation 0.0010 256 0.150 0 0.033 0.000 0.000 0.000 0.996
71 validation 0.0010 256 0.150 3 0.121 0.016 0.016 0.016 0.951
72 validation 0.0010 256 0.150 5 0.235 0.043 0.043 0.043 0.906
73 validation 0.0010 256 0.150 10 0.407 0.100 0.100 0.100 0.863
74 validation 0.0010 256 0.150 20 0.631 0.172 0.172 0.172 0.658
75 validation 0.0010 256 0.150 40 0.866 0.381 0.381 0.381 0.565
76 validation 0.0010 256 0.150 80 1.054 0.498 0.498 0.498 0.269
77 validation 0.0010 512 0.150 0 0.001 0.000 0.000 0.000 0.999
78 validation 0.0010 512 0.150 3 0.085 0.014 0.014 0.014 0.971
79 validation 0.0010 512 0.150 5 0.132 0.031 0.031 0.031 0.937
80 validation 0.0010 512 0.150 10 0.251 0.062 0.062 0.062 0.875
81 validation 0.0010 512 0.150 20 0.356 0.117 0.117 0.117 0.815
82 validation 0.0010 512 0.150 40 0.512 0.203 0.203 0.203 0.559
83 validation 0.0010 512 0.150 80 0.655 0.316 0.316 0.316 0.395

Top Mutated Amino Acids

# 0 1 2 3 4 5 6 7 8 9
from C H Q T N Y W F M S
to L A R E G P S K V T

Top Mutations

from to
F L
W L
C L
Y L
M L
T L
H L
I L
H R
G L
Q L
S L
N L
C A
K L
T A
W A
Q R
D L
Q E